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Amendments to the Drawings: 

The attached sheets of drawings include changes to Figs. 3B and 5B and the 
addition of Fig. 4C. Fig. 4C is disclosed in paragraph [0077] of the specification as filed. These 
sheets replace the substitute sheets recently submitted with the Response to Notice to File 
Missing Parts mailed January 7, 2004. 
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REMARKS/ARGUMENTS 
Claims 1-51 and claims 53-63 were pending. By this amendment, the 

specification has been conformed to correct typographical and grammatical errors, and a 

Substitute Specification and Comparison Copy are submitted herewith. Thus, claims 1-51 and 

claims 53-63 remain pending for consideration. 

A set of replacement drawing sheets and a set of drawing sheets annotated to 

correct issues with figure formalities are attached herewith. Fig. 4C is added and is presented 

along with the set of replacement drawing sheets. Fig. 4C is disclosed and fully supported in 

paragraph [0077] of the specification as filed. Applicant avers that no new matter is added by 

this amendment. 

The Examiner has objected to the summary section, paragraph [0007], with 
respect to the term "information additive code." Claims 1-51 and 53-63 stand rejected under 35 
USC §112. Claims 1, 2, 6, 8, 12-14, 24, 25, 27, 35, 36, 38, 39, 41, 42, 45, 46, 49, 53, 54, 57, 58, 
and 61 stand rejected under 35 USC §102(a) as being anticipated by U.S. Patent No. 6,012,159 
issued to Fischer (hereinafter Fischer). Claims 1, 2, 4-8, 12-14, 21-28, 32-47, 49, 50, 53-55, 57- 
59, 61, and 62 stand rejected under 35 USC §102(a) as being anticipated by U.S. Patent No. 
6,081,907 issued to Witty (hereinafter Witty). Claims 4, 5, 9, 10, 17, 18, 21, 32, 43, and 44 stand 
rejected under 35 USC § 103(a) in view of Fischer. Claims 9, 10, 17, and 18 stand rejected under 
35 USC § 103(a) in view of Witty. Claim 1, 3, 14, 15, 20, 27, 30, and 31 stand rejected under the 
judicially created doctrine of obvious-type double patenting in view of copending applications 
10/032,156, 10/367,573, 10/459,370, and U.S. Patent No. 6,307,487. Applicant has submitted a 
terminal disclaimer with this response. 

Objections to Specification 

Applicant submits that the term "information additive code" is fully supported at 
least in the specification as filed. Conventional forward error correction code schemes (e.g., 
erasure codes) are not information additive but are information duplicative . Generally, 
conventional forward error correction code methods such as Reed-Solomon, Tornado, etc., by 
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design require redundant information to recover data packets and generate duplicate information 
in the process due to constraints on the number of output symbols that can be generated for a set 
of input symbols. For example, consider the case of two independent transmitters randomly 
broadcasting the same data packets using Tornado coding scheme. If the two transmitters are not 
coordinated or synchronized, i.e., the transmission times are not correlated, the two transmitters 
are likely to broadcast the same output symbols due to the limit on the number of output symbols 
available. Thus, with regard to conventional forward error correction codes, it is highly likely 
that the information transmitted from one uncorrelated transmitter will be duplicative of what is 
transmitted from another uncorrelated transmitter. As a result, transmitters normally need to be 
coordinated. 

With regard to information additive codes of the present invention, due to the 
claimed chain reaction coding and decoding process, and the large, effectively unbounded key 
set, an effectively unbounded number of output symbols may be generated. With such a large 
number of uniquely encoded output symbols (e.g., billions) relative to the number of output 
symbols needed to recover data (e.g., thousands of output symbols), it is highly unlikely that the 
encoded output symbols being transmitted will ever repeat or be duplicated across transmitters 
and therefore are information additive . 

Information additive codes are well defined in the specification as "data that helps 
in the recovery process rather than being duplicative of information already available ." Further, 
the specification discloses the timing of the transmission and the reception of the encoded output 
symbols is uncorrelated (e.g., does not have to be in sync). For example, the specification 
recites in part that the system "does not require the recipient begin receiving at any given point in 
the transmission and does not require the sender to stop transmission after a set number of output 
symbols are generated." Therefore, it is clear that conventional erasure codes are completely 
different from information additive codes disclosed in the present application. 

35 USC §112 Rejections 

Claims 1-51 and 53-63 stand rejected under 35 USC §112. The Examiner 
asserted the term "information additive code(s)" is unclear and inconsistently presented and that 
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with regard to claim 49, "from one of a plurality of sources" presumably should be "from one or 
more of a plurality of sources." Per the arguments above, Applicant submits that the term 
"information additive code" is fully supported at least in the specification as filed. Applicant has 
amended claim 49 per the Examiner's suggestion. 

35 USC §102 and §103 Rejections 

Claims L 14, 27, 38, 45, 49, 53, 57, and 61 

The Examiner stated that Fischer and Witty disclose encoding n > k coded 
packets from a k number of file packets. The Examiner asserted that both Fischer and Witty 
could reconstruct the original k file packets using a k number of encoded packets regardless of 
which k encoded packets are received and are therefore information additive. The rejection is 
respectfully traversed. 

Applicants submit that claims 1, 14, 27, 38, 45, 49, 53, 57, and 61 are allowable 
over Fischer and Witty as they do not teach or suggest all of the elements of the claims, alone, or 
in combination as the claimed method and system do not require coordination between 
transmitters to avoid output symbol duplication. For example, claims 1, 14, and 45 as amended 
partial recite that the "information additive code[s] transmitted". . ."at any particular time is 
independent of the information additive codefsl previously transmitted ." Similarly, claims 27, 
38, and 49 recite in part "wherein the information additive code[s] received". . ."at any particular 
time is independent of the information additive codeM previously received ." Claim 53 as 
amended recites in part "wherein the output symbols modulated". . ."at any particular time is 
independent of the output symbols previously modulated onto the carrier signal." Claim 57 as 
amended recites in part "wherein the information additive code when transmitted". . ."is 
independent of the information additive code previously transmitted ." Claim 61 as amended 
recites in part "wherein the information additive code, when received, is independent of 
information additive code previously received ." 

Fischer discloses that a computer receiving n packets from originally encoded 
packets k can recover an original packet sequence of encoded packets k, as long as n > k. Fisher, 
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Abstract, col. 4 lines 29-60). Witty relies on receiving specific packets and a specific sequence 
of packet reception. (Witty, Abstract, col. 1, line 64 through col. 2, line 35, col.6, lines 40-61, 
and col. 8 lines 44-52). Fischer and Witty rely on methods and systems that are constrained by 
the number of output symbols that can be generated for a set of input symbols and therefore 
require coordination of transmission between transmitters in order to avoid output symbol 
duplication. Thus, Fischer and Witty are not "information additive" because they require 
transmitter coordination (e.g., output symbol broadcasting coordination) . Therefore, claims 1, 
14, 27, 38, 45, 49, 53, 57, and 61 are patentably distinguished over Fischer and Witty alone, or in 
combination, for at least the above reasons. 

Dependent claims 2. 4-10. 12-13. 17-18. 21-26. 28. 32-36. 39-44, 46-47. 50. 52. 54-55. 58-59, 
and 62 

Claims 2, 4-10, and 12-13 depend from claim 1, claims 17-18, and 21-26, depend from 
claim 14, and claims 46-47 depend from claim 45, and are therefore allowable for at least the 
reasons discussed in relation to amended claim 1, 14, and 45. Claims 28 and 32-36 depend from 
claim 27, claims 39-44 depend from claim 38, and claims 50 and 52 depend from claim 49, and 
are therefore allowable for at least the reasons discussed in relation to amended claims 27, 38, 
49. Claims 54-55 depend from claim 53, claims 58-59 depend from claim 57, and claim 62 
depends from claim 61, and are therefore allowable for at least the reasons discussed in relation 
to amended claims 53, 57, and 61. Accordingly, withdrawal of the rejection of dependent claims 
2, 4-10, 12-13, 17-18, 21-26, 28, 32-36, 39-44, 46-47, 50, 52, 54-55, 58-59, and 62, is 
respectfully requested. 

Double Patenting Rejections 

An appropriate terminal disclaimer is submitted herewith to overcome the double- 
patenting rejection. Hence, it is respectfully submitted that claims 1, 3, 14, 15, 20, 27, 30, and 31 
are now allowable. 
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PATENT 



CONCLUSION 



In view of the foregoing, Applicant believes all claims now pending in this 



Application are in condition for allowance. The issuance of a formal Notice of Allowance at an 
early date is respectfully requested. 



If the Examiner believes a telephone conference would expedite prosecution of 



this application, please telephone the undersigned at 415-576-0200. 



TOWNSEND and TOWNSEND and CREW LLP 

Two Embarcadero Center, Eighth Floor 

San Francisco, California 941 1 1-3834 

Tel: 415-576-0200 

Fax:415-576-0300 

Attachments 

CBS:rgy 

60539737 v1 




Reg. No. 41,516 
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Attorney Docket 19186-000650US 



Gra ss Reference to Related Applications 

[0001] — Th is application is a continuation in part of application no. 10/076,623, filed 
February 11, 2002, which is a continuation of application no. 09/757,078, filed 
10 January 8, 2001, now U.S. Pat. No. 6,373, 4 06, which is a continuation of application 
no. 09/246,015, filed February 5, 1999, now U.S. Pat. No. 6,307,187, which claims 
th e b e nefit of provisional application no. 60/101, 4 73, filed September 23, 1998. 

15 CROSS REFERENCE TO RELATED APPLICATIONS 

[0001 1 The following references are herein incorporated in their entirety for all 
purposes: 

a) Commonly assigned U.S. Patent No. 6,373,406, entitled "Information 
Additive Code Generator and Decoder for Communication Systems" (hereinafter 



b) Commonly assigned U.S. Patent Application No. 09/768,843, filed January 
23, 2001, entitled "Methods and Apparatus for Scheduling, Serving, Receiving 
Media~on-Demand For Clients, Servers Arranged According to Constraints and 
Resources" (hereinafter "MOD"); 



December 21, 2001, entitled "Multi-stage Code Generator and Decoder for 
Communication Systems" (hereinafter "Raptor"); 

d) Commonly assigned U.S. Patent Application No. 10/367,573, filed 
February 14, 2003, entitled "Systems and Methods for Reliably Communicating the 

30 Content of a Live Data Stream" (hereinafter "Rasmussen"); and 

e) Commonly assigned U.S. Patent Application No. 10/459,370, filed June 10, 
2003, entitled "Systems and Processes for Decoding Chain Reaction Codes Through 
Inactivation" (hereinafter "Shokrollahi"). 



20 



Lubv I"); 



25 



c) Commonly assigned U.S. Patent Application No. 10/032,156, filed 
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5 

B ackground 

BACKGROUND OF THE INVENTION 
[0002] The present invention relates generally to systems and methods for 
10 broadcasting information, and more particularly to systems and methods for 

broadcasting information, data or content, to intermittently- available receivers, such 
as mobile receivers. 

[0003] A conventional approach to broadcasting data to a large number of 
receivers is referred to as the "data carousel" protocol. Using this approach, 

15 broadcast data is usually split into equal-sized packets, each of which forms a section 
in a data carousel. Each section is then broadcast over a specific period of time, and 
the data carousel continues to repeat to transmit those data portions that one or more 
receivers did not receive. Usually the broadcasting terminal (e.g., a network server, 
satellite or terrestrial transmitter) will need to transmit the data in the repeated fashion 

20 many times since it is usually not possible to synchronize the receivers to receive the 
transmitted data during one transmission period. The continued transmission of the 
same data set reduces the transmitter's efficiency, and as the transmission cycles 
continue, successively fewer receivers benefit from the transmission. 

[0004] Further complicating this approach is the observation that in many 
25 applications, each receiver, through its normal course of operation, may itself be 

switched on and off during a transmission period. Systems such as automotive-based 
data receivers (e.g., on-board navigation systems), global positioning systems, cellular 
handsets, and portable computers employing 802.1 lx wireless communication 
protocols are but a few examples of such receivers. The sheer number of these 
30 receivers combined with their intermittent operation greatly increases the number of 
transmission cycles required to ensure that a large majority of the receivers have 
received all data segments. 

[0005] Forward error/erasure correction (FEC) represents a conventional 
improvement to the data carousel approach. In this approach, a forward error 
35 correction algorithm is applied to each of the data segments, producing redundant data 
for that segment. This approach is an improvement over the data carousel, as the 
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5 receiver needs only receive a subset of each data segment to correctly decode it. This 
results in fewer transmission cycles being needed to disseminate the broadcast data to 
a large majority of receivers. While providing an improvement, the FEC data 
carousel systems still has the disadvantages that: (1) each receiver must still receive a 
relatively large portion of each data segment; and (2) prior art FEC codes used in such 

10 data carousel systems, such as Reed-Solomon codes, require computational resources 
well beyond that which is available or commercially feasible in many applications. 
As noted above, many of the intermittently available receivers will not remain 
continuously on during a transmission period, and accordingly, a large number of 
repeated transmission cycles will be needed. It is expected that in practice some 

15 receivers will receive all segments quickly, while others will take a long time, 

resulting in the aforementioned condition of repeatedly broadcasting previous data 
over a long period to achieve a high rate of successful receptions. 

[0006] What is therefore needed are systems and methods for broadcasting data to 
receivers, including mobile and intermittently available receivers, in a more efficient 
20 manner. 

Su mmary 

BRIEF SUMMARY OF THE INVENTION 
[0007] The present invention describes new systems and methods for broadcasting 

25 data to all types of receivers, including those intermittently available such as mobile 
receivers, in a highly efficient manner using information additive coding. Information 
additive coded information (herein referred to as "information additive codes," 
exemplary embodiments of which include "LT Codes," "Raptor Codes," and "Chain 
Reaction Codes" described in the assignee's references incorporated herein) exhibits 

30 the unique property that any coded segment can be used to recover the original source 
data. Accordingly, a receiver in such a system need only receive some threshold 
amount of the coded data, regardless of what particular segment it contains, or when it 
is received. The receiver in such a system also does not rely on a backchannel to 
ensure reception of all transmitted data. These properties make the present invention 

35 useful for broadcasting systems, and particularly advantageous for systems 

broadcasting to intermittently available receivers, as data can be recovered efficiently 
at all times during reception periods. 
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5 [0008] In a particular embodiment of the invention, a broadcasting system is 

described having one or more information additive code transmitters and one or more 
information additive code receivers. Each of the information additive code 
transmitters includes an encoder configured to receive source data and to produce 
information additive code therefrom. Each of the information additive code receivers 
10 includes a decoder configured to receive the information additive code and to 
reconstruct therefrom substantially a copy of the source data. 

[0009] This and other systems and methods of the present invention are provided 
below, a better understanding of which can be obtained with reference to the 
following figures and description. 



[0010] Figs. 1 A and IB illustrates illustrate a system and corresponding method for 
broadcasting information additive codes in accordance with the present invention. 

20 Fig. 2 A illustrates a first embodiment of the broadcast transmitter shown in Fig. 1 A in 
accordance with the present invention. 

Fig. 2B illustrates a method of converting input symbols into a coded transmission 
using the broadcast transmitter shown in Fig. 2A in accordance with one embodiment 
of the present invention. 

25 Fig. 3 A illustrates a second embodiment of the broadcast transmitter shown in Fig. 1 A 
in accordance with the present invention. 

Fig. 3B illustrates one embodiment of the symbol encoder shown in Fig. 3A in 
accordance with the present invention. 

Fig. 3C illustrates a method of converting input symbols into a coded transmission 
30 using the broadcast transmitter shown in Fig. 3A in accordance with one embodiment 
of the present invention. 

Fig. 4A illustrates a first e mbodiment of the broadcast receiver shown in Fig. 
4rA simplified block diagram of an improved encoder in accordance with the present 
invention. 
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Brief Description of the Drawings 



BRIEF DESCRIPTION OF THE DRAWINGS 
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5 Fig. 4B illustrates a method of recovering input symbols from a coded transmission 
using th e broadcast r e c e iv e r for encoding data with the improved encoder shown in 
Fig. 4A in accordance with one embodiment of the present invention. 

Fig. SA4C illustrates a second embodiment of the broadcast recei v e r shown in Fig. 
1 A in accordanc e with the present invention improved encoder comprising a multiple 
10 engine encoder . 

Fig. 5B illustrates a method for operating the broadcast transmitter shown in 
Fig. 5 A in accordance with the invention. 

Fig. 5 A illustrates a general encoding process which may be used in system 
broadcasting live streaming data. 

1 5 Fig. 6A5B illustrates a m e thod for d e coding the information additiv e codes using 
inactivatio n specific embodiment for the encoding process for a live data stream in 
accordance with one embodiment of the present invention. 

Fig. 6B illu s trat e s on e e mbodim e nt of the start up proc e ss illustrat e d in Fig. 6A . 5C 
illustrates a signal timing diagram for signals communicated in accordance with the 
20 method of Fig. 5B. 

Fig. 6A illustrates a first embodiment of a receiver, as might be used in the system of 
Fig. 1 A, comprising a single-stage information additive code receiver in accordance 
with the present invention. 

Fig. 6B illustrates a method of recovering input symbols from a coded transmission 
25 using the receiver shown in Fig. 6A. 

Fig. 6C illustrates a first embodiment of th e source symbol selection and deactivation 
process illustrated in Fig. 6A. 7A illustrates a second embodiment of the receiver 
comprising a multistage information additive code receiver in accordance with the 
present invention. 

30 Fig. 6©7B illustrates one embodiment of the sourc e symbol recovery proces s 
illustrated in Fig. 6 A symbol decoder in accordance with the invention . 

Fig. 7 A illustrate s a gen e ral e ncoding proc e ss which may b e used in system 
broadcasting live streaming data. C illustrates a method of recovering input symbols 
from a coded transmission using the receiver shown in Fig. 7A. 
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5 Fi.g.7B illustrat e s a specific embodiment for encoding proc e ss for a liv e data 

str e am in accordanc e with the present invention. 

Fig. 7G8A illustrates a signal timing diagram for signals communicated method for 
decoding the information additive codes using inactivation in accordance with the 
m e thod of Fig. 7B one embodiment of the present invention . 

10 Fig. 8 B illustrates one embodiment of the start-up process illustrated in Fig. 8A. 

Fig. 8C illustrates a first embodiment of the source symbol selection and deactivation 
process illustrated in Fig. 8A. 

Fig. 8 D illustrates one embodiment of the source symbol recovery process $5© 
illustrated in Fig. 8A . 

15 Fig. 9 A illustrates one embodiment of the present invention comprising a system for 
broadcasting data to a large number of mobile terminals. 

Fig. 9B illustrates another embodiment of the present invention comprising a system 
for broadcasting live streaming data to a large number of mobile terminals. 

[001 1 ] For clarity and convenience, features and components which are identified 
20 in earlier drawings retain their reference numerals in subsequent drawings. 

D e tailed D e scription of Specific Embodiments 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 
[001 2] The broadcasting system and methods of present invention can be used in a 

25 variety of applications, particularly in mobile systems in which the receiver may be 
switched on and off during its normal course of operation. For example, the system 
may be used to update map databases in automotive-based receivers periodically 
without the driver's knowledge or intervention. In other applications, the 
broadcasting system may be used to send passenger manifests to train conductors 

30 while the train is in motion, updating and broadcasting weather information to 

receivers installed on boats ^ and planes, or sending information to PDAs, cell phones, 
and the like. Other applications of the present invention are further described below 
with reference to Figs. 9 A and 9B. 
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5 System Overview 

[001 3] Figs. 1 A and IB illustrat e s illustrate a general block diagram of system and 
corresponding method for broadcasting information additive codes in accordance with 
the present invention. In a particular embodiment described below, the system is 
configured to broadcast information additive codes to a number of mobile terminals, 
1 0 for example a number of automobiles. 

[0014] Referring first to Fig. 1 A, the exemplary broadcast system 100 includes one 
or more information additive code transmitters (transmitters) 1 10i-n, each of which 
sends a coded transmission 1 15i_n across a primary channel 120 to one or more 
information additive code receivers (receivers) 130i_ N . The coded transmission 115 

1 5 comprises the information additive codes which isare modulated or multiplexed in the 
appropriate manner to facilitate transmission to the receivers 130i_n. In those 
embodiments in which no multiplexing or modulation is needed for broadcast 
transmission, the term coded transmission will refer to the information additive codes 
themselves. The information additive codes are comprised of output symbols, the 

20 generation of which is further described below. 

[001 5] In a particular embodiment as shown, the source data 105 is supplied to 
two or more transmitters 1 10i_n. This embodiment can be employed to provide 
redundancy over the primary channel 120, or to increase the effective reception rate of 
the receivers 130, as the information additive receivers are capable of decoding the 

25 coded transmission upon receiving any suitable number of coded blocks, without 

regard to the particular data block received. In an alternative embodiment, different 
source data is supplied to different transmitters. In this instance, different transmitters 
can be used to simultaneously transmit different content, among which the receiver 
can selectively choose between . In a third embodiment, the source data 105 con s ists 

30 e fcomprises diverse data multiplexed onto a single stream supplied to the transmitters 
1 IOi-n- As in the previous embodiment, this arrangement provides the ability to 
concurrently broadcast several different programs to the receivers 130i- N from which 
it a receiver can selectively choose. 

[00 16] One or more of the receivers (receiver 130i as shown) are configured to 
35 receive the coded transmission 114 via a secondary channel 140. The secondary 
channel 140 provides an alternate communication route should reception via the 
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5 primary channel not be possible. The secondary channel 140 preferably comprises a 
channel complimentary to that of the primary channel, for example, a telephone or 
cable modem line or terrestrial link in the instance in which the primary channel 120 
is a satellite link. In a particular embodiment, the secondary channel 140 provides 
additive information codes data which kas have not been sent over the primary channel 
10 120. To achieve this, either the secondary channel 140 has its own dedicated additive 
information codes transmitter, or some encoded data is diverted from primary channel 
120. 

[00 1 7] The transmission channel (primary 1 20 or secondary 140) may comprise 
any of several communication architectures suitable for the particular multi 

15 eas tmulticast or broadcast application. For example, the transmission channel may 
comprise an internal bus architecture operable to communicate data within a 
microprocessor or computer system. In another embodiment, the channel consists 
e fcomprises an external computer network, such as a local area network, a medium 
iif©as are a network, wide area network, or the Internet, in which one source (e.g., a 

20 server) broadcasts data to one or more computers. In a third embodiment, the 

transmission channel consists o f comprises a telephone line (analog or digital), cable 
(electronic or fiber optic), or other structure which can guide and support the 
propagation of a data signal. In a fourth embodiment, the channel comprises a free 
space (RF/electromagnetic or optical wavelength) terrestrial or space-based 

25 communications link. The mode of communication employed, e.g., electrical or 

optical, format of modulation, transmission via a guided structure or free space, is a 
design choice, and any means for communicating information from one or more 
transmitters to one or more receivers may be used as a transmission channel in the 
present invention. Further, a recording/storage device 122 N (e.g., tape drive, hard disk 

30 drive, memory, etc.) may be used to record/store the coded transmissions 1 15 N 

broadcast from each transmitter 130n- The recording/storage devices 122 may be 
used to provide playback of earlier transmitted data when requested. 

[00 1 8] Referring now to Fig. 1 B, the operation of the system 1 00 begins at 1 5 1 
when the original source data 105 is supplied to one or more of the transmitters 110. 
35 The source data 105 can be in any form or structure, e.g., a data stream, a data file, 
etc., and may consist o f comprise a multiplexed stream of diverse data. The source 
data 105 may be supplied in a segmented size which is more optimally processed, or 
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5 the segmentation process may occur within the transmitter and/or receiver structures 
as described below. 

[0019] Subsequently at 152, the supplied source data is encoded into information 
additive codes, modulated onto a carrier signal (when needed), and transmitted via the 
primary or secondary channels 120 or 140. In one embodiment, the source data 105 is 

10 encoded using a single z stage information additive code generator described in the 
assign e e' s pending US Patent Applicat i on No. 1 0/076,623 entitled: "Information 
Additiv e Cod e G e nerator and D e coder for Communication Syst e ms" incorporat e d by 
ref e renc e Luby I . In another embodiment, the source data is encoded using a multi 
stagemultistage information additive code generator as described in the assigne e 's US 

15 Patent Application No. 10/032, 156, entitled: "Multi stage Code Generator and 

Decoder for Communication Systems," incorporat e d by r e ferenc eRagtor. Exemplary 
embodiments of these such encoding systems and processes are further described 
below. 

[0020] As shown and described above, the coded transmission 115 may be sent via 
20 two or more transmitters 1 10i_n in order to provide redundancy, an increased 

reception rate, or multiple data programs. Alternatively, the coded transmission 115 
may be made available to one or more receivers via a secondary channel 140 to 
provide redundancy. Further alt e mati v e ly As a further alternative, the second channel 
140 may carry a different coded transmission, such as a different source data or 
25 session information, further described below. 

[002 1 ] The format and size of the coded transmission 115 will vary depending 
upon the particular data application, transmission channel, and receiver requirements. 
Possible formats include UDP packets, MPEG data streams, ATM cell streams, serial 
byte streams, file(s) in a shared storage medium, FDDI data streams or SCSI 
30 command and data streams, satellite transmissions, cellular phone transmissions, PCS 
transmissions, GSM transmissions, HDTV transmissions, or similarly- formatted 
transport. Further preferabl v Preferably , the coded transmission is composed of 
atomic medium blocks (AMBs) which are native to, or optimally processed by the 
transmission channel and/or the receivers 130. 

35 [0022] At 153, the coded transmission 1 15 is received by one or more of the 

receivers 130, each receiver 130 configured to recover a copy of the source data 105 

10 
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5 therefrom. In one embodiment, the coded transmission 1 15 is decoded using a single 
-stage information additive code decoded describ e d in the as s ignee's pending US 
Patent Application No. 10/076,623 e ntitl e d: "Information Additive Code Generator 
and Decoder for Communication Systems" incorporated herein by r e ference as 
described in Lubv I . In another embodiment, the coded transmission is decoded using 
10 a multi stage multistage information additive code decoder as described in the 
assignee's US Patent Application No.10/032,156, entitled: "Multi stage Code 
Generator and Decoder for Communi ca ti o n Systems," incorporated h e rein by 
r e ference Raptor . Exemplary embodiments of these such decoding systems and 
processes are further described below. 

15 Exemplary Broadcast Transmitters and Processes 

[0023] Fig. 2 A illustrates a first embodiment of the transmitter 110, comprising a 
single iStage information additive code transmitter in accordance with the present 
invention. The term "transmitter" is used genetically to refer to the unit's function, 
and may comprise a network server, central processing unit or other device from 

20 which instructions or data originate, a satellite or terrestrial radio transmitter, network 
device, or any such unit which is configured to encode d encode and transmit source 
data as described herein. 

[0024] The single r stage transmitter 110 includes ana single-stage encoder 210, a 
protocol converter 220, and a transmit module 230. The single-stage encoder 210 

25 includes an input symbol generator 211, symbol encoder 212, key generator 213, 

counter 214, stream identifier 215, and a random number generator 216. The single - 
stage encoder 210 and corresponding method of operation are generally as described 
in the commonly assigned US Pat. No. 6,373,406 entitl e d "Information Additive Cod e 
Generator and Decod e r for Communication Sy s tems,"(Luby I) th e cont e nts of which 

30 is incorporat e d by ref e rence. Lubv I. 

[0025] Input symbol generator 211 generates an ordered sequence of one or more 
input symbols (IS(0), IS(1), IS(Q), . . . ) from the source data 105, with each input 
symbol having a value and a position (denoted in FIG. 2A as a parenthesized integer). 
The possible values for input symbols, i.e., its alphabet, is typically an alphabet of 2 M 
35 symbols, so that each input symbol codes for M bits of the input file. The value of M 
is generally determined by the parameters of the system 100, but a general purpose 

11 
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5 system might include a symbol size input for input symbol generator 21 1 so that M 
can be varied from use to use. The output of input symbol generator 21 1 is provided 
to a symbol encoder 212. 

[0026] Key generator 213 generates an encoding key for each output symbol to be 
generated by the symbol encoder 212. Each encoding key is generated according to 

10 one of the methods described herein, in Luby I, or any comparable method that 

insures that a large fraction of the keys generated for the same input file are unique, 
whether they are generated by this or another key generator. For example, key 
generator 213 may use a combination of the output of a counter 214, a unique stream 
identifier 215, and/or the output of a random generator 216 to produce each key. The 

15 output of key generator 213 is provided to the symbol encoder 212. 

[0027] From each encoding key I provided by key generator 213, encoder 212 
. generates an output symbol, with a value B(I), from the input symbols provided by the 
input symbol generator. The value of each output symbol is generated based on its 
key and on some function of one or more of the input symbols, referred to as the 

.20 output symbols "associated input symbols." The selection of the function (the 

"value function") and the associates is done according to a process described in Luby 
I. Typically, but not always, M is the same for input symbols and output symbols, 
i.e., they both code for the same number of bits. In some embodiments, the number K 
of input symbols is used by the encoder to select the associates. If K is not known in 

25 advance, such as where the input is a streaming file, K can be just an estimate. The 
value K might also be used by symbol encoder 212 to allocate storage for input 
symbols. 

[0028] The protocol converter 220 receives the output symbols and keys, and 
formats each to the protocol appropriate for the particular broadcast system. 
30 Exemplary broadcast protocols include TCP/IP, UDP/IP, MPEG, Digital Video 
Broadcast, satellite radio, terrestrial digital radio, as well as other network and/or 
broadcasting system protocols. In alternative embodiments of the transmitter 1 10 in 
which the protocol of the output symbols and keys do not require reformatting, the 
protocol converter 220 is omitted or bypassed. 

35 [0029] The output symbols and keys are next supplied to the transmit module 230. 
The transmit module operates to broadcast the output symbols over the primary and/or 

12 



U.S. Patent Application filod July 10, 2003 Description 
Foioy ot. al. Pago 13 of 39 

5 secondary channels 120 and/or 140, and depending on the keying method used, the 
transmit module 230 might also transmit some data about the keys of the transmitted 
output symbols. The transmit module 230 can be any suitable hardware components, 
software components, physical media, or any combination thereof, so long as it is 
adapted to transmit output symbols and associated key information. The transmit 

1 0 module may comprise, for example, a multiplexer or a modulator operable to 

modulate the output symbols and key data onto a carrier signal, front-end electronics 
to condition the carrier signal as needed, and a signal transmission means, e.g., an 
antenna, optical lens/telescope, cable modem, network interface card, 802.1 lx radio 
card, or other similar devices to transmit the carrier signal, said carrier signal 

1 5 comprising the coded transmission. Any particular modulation format may be used, 
for instance, OFDM (orthogonal frequency division multiplexing), coded OFDM, 
QAM (quadrature amplitude modulation), CDMA (code division multiple access), 
QPSK (quadrature phase shift keying), and the like. 

[0030] Fig. 2B illustrates a method of converting input symbols into a coded 
20 transmission using the single ; stage transmitter 110 shown in Fig. 2 A in accordance 
with one embodiment of the present invention. Initially at 242, the source data is 
arranged in an order set of input symbols, a process that is performed by the input 
symbol generator 21 1 in one embodiment. Subsequently at 244, a plurality of output 
symbols B(Io), B(Ii), etc. are generated from the ordered set of input symbols IS(0), 
25 IS(1), etc., using the above-described symbol encoder 212, key generator 213, counter 
214, stream identifier 215, and random number generator 216. In one embodiment, 
the output symbols are generated as a function of the input symbols IS(0), IS(1), etc. 
and corresponding encoding keys Io, Ii, etc. In one embodiment, the function is an 
exclusive-or (XOR) operation, although any arithmetic function may be used in the 
30 alternative. Preferably, the number of output symbols is much larger than the number 
of input symbols in the ordered set. Furthe r More preferably, at least one output 
symbol is generated from more than one, but fewer than all of the input symbols in 
the ordered set. 

[003 1 ] Next at 246, the plurality of output symbols areis broadcast over a 
35 transmission channel (primary and/or secondary channels 120 and/or 140). In the 

preferred embodiment, the transmitted output symbols are decodable into the order set 
of input symbols when the quantity N of the transmitted output symbols are received, 

13 
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5 where N is greater than one, but much less than the number of possible output 
symbols. 

[0032] Fig. 3 A illustrates a second embodiment of the transmitter 110 comprising 
a multi stage multi stage information additive code transmitter in accordance with the 
present invention. Multi s tag e Multi stage encoding is particularly useful in the 
10 instance in which when the recipient joins or leaves the broadcast at times other then 
the commencement or termination of the broadcast. This scenario occurs frequently 
in broadcast applications, making the present invention particularly useful. 

[0033] Multi stag e Multistage transmitter 110 of Fig. 3 A is constructed similarly to 
the single r stage transmitter illustrated in Fig. 2A above, and includes a multi 

1 5 stage multistage encoder 3 1 0, a protocol converter 320 and a transmitt e rt ransmit 
module 330. The protocol converter 320 and transmit module 330 operate in the 
manner as described above in Fig. 2A. The multi stag e m ultistage encoder 310 
employs a two -stage coding scheme as described in the commonly assigned patent 
application no. 10/032,156 entitled "Multi stag e Cod e Gen e rator and Decoder for 

20 Communication Systems/' (referred to as Raptor) incorporated herein by reference. 
Raptor. 

[0034] During encoder operation, source data 105 is provided to the input symbol 
gen e rated gen erator 311 which, in response, produces an ordered sequence of one or 
more input symbols IS(0), IS(1), IS(Q), . . . , each input symbol having a value and a 

25 position in the manner as described in Fig. 2 A. The static key generator 313 produces 
the stream of static encoding keys in response to a seed value supplied to it by the 
random number generator 315. The dynamic key generator generates a dynamic 
encoding key for each output symbol to be generated. Preferably, each dynamic 
encoding key is generated so that a large fraction of the dynamic keys for the same 

30 input file are unique. 

[0035] The symbol encoder 312 receives the ordered sequence of input symbols 
IS(0), IS(1), etc., a stream of static keys S 0 , Si, etc., and a stream of dynamic keys Io, 
Ii, etc, producing, in response, respective output symbols B(Io), B(Ii), etc. The value 
of each output symbol is generated based on its key, on some function of one or more 
35 of the input symbols, and possibly on one or more redundant symbols that had been 
computed from the input symbols. The collection of input symbols and redundant 
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5 symbols which are correlated to a specific output symbol are referred to as being 
associated with that output symbol. In some embodiments, the number of K input 
symbols is used by the symbol encoder 312 to select the associated input symbols. If 
K is not known in advance, such as where the input is a streaming file, K can be 
estimated. The value of K may be used by the symbol encoder 3 12 to allocate storage 
10 for input symbols and any intermediate symbols generated by the symbol encoder 
312. 

[0036] Fig. 3B illustrates one embodiment of the symbol encoder 312 in 
accordance with the invention. The symbol encoder 312 includes a static encoder 
312a, a dynamic encoder 312b, and a redundancy calculator 312c. The static encoder 

15 receives the sequence of input symbols IS(0), IS(1), etc., the number of K input 
symbols, a respective sequence of static keys So, Si, etc., and a number R of 
redundant symbols. Responsive to these inputs, static encoder 312a generates a 
respective sequence of R redundant symbols RE(0), RE(1), etc. In some 
embodiments, the redundant symbols generated by the static encoder 312a are stored 

20 in an input buffer 3 12d. Input symbol buffer 3 12d na ymay be only logical, i.e., the 
file may be physically stored in one place and the positions of the input symbols 
within the symbol buffer 31 2d could be onlv~be renamings of the positions of these 
symbols within the original file. 

[0037] The dynamic encoder 3 12b roccivers receives the sequence of input 
25 symbols IS(0), IS(1), etc., dynamic encoding keys I 0 , Ii, etc., and the sequence of 

redundant symbols RE(0), RE(1), etc. and, in response, generates the output symbols 
B(Io), B(I0, etc. In the embodiment in which the redundant symbols are stored in the 
input symbol buffer 3 12d, the dynamic encoder 312b receives the input symbols and 
redundant symbols from the input buffer 3 12d. The redundancy calculator 3 12c is 
30 operable to comput e r compute the number R of redundant symbols from the number K 
of input symbols, a process which is further described in the Raptor reference 
incorporated herein. 

[0038] Fig. 3C illustrates a method of converting input symbols into a coded 
transmission using the multi stage m ultistage transmitter 110 shown in Fig. 3 A in 
35 accordance with the present invention. Initially at 342, the source data is arranged in 
an order set of input symbols IS(0), IS(1), etc., a process that is performed by the 



15 



U.S. Patent Application fil o d July 10, 2003 Description 
Foisy ot. al. Pago 16 of 39 

5 input symbol generator 3 1 1 in one embodiment. Subsequently at 344, a plurality of 
redundant symbols RE(0), RE(1), etc. areis generated as a function of input symbols 
IS(0), IS(1), etc. and corresponding static keys So, Si, etc., as described in Fig. 3B. 
Next at 346, a plurality of output symbols B(Io), B(Ii), etc. afejs generated from a 
combined set of the input symbols IS(0), IS(1), etc. and the redundant symbols RE(0), 

10 RE(1), etc., and the output symbols broadcast over a transmission channel (primary 
and/or secondary channels 120 and/or 140). In the preferred embodiment, the 
number of output symbols is much greater than the number of symbols in the 
combined set of input and redundant symbols. Furthe r More preferably, at least one 
output symbol is generated from more than one, but fewer than all of the combined 

15 symbols. 

[0039] The above-described encoders 210 and 310, protocol converters 220 and 
320, and transmit modules 230 and 330 may individually b e eaeb-realized in a variety 
o f diff e r e nt forms, such as in hardware, in software/firmware, or a combination of 
these components. When partially or entirely implemented in software or firmware, 

20 the required functionality may be provided by instruction code which controls a 

computer, microprocessor, or other programmable system to perform the described 
processes. In such embodiments, the instruction code may be stored on a readable 
medium such as a hard drive, other disk, microprocessor memory, or other such 
device whic h that is suitable to store the instruction code. Further, encoders 210 and 

25 310, protocol converters 220 and 320, and transmit modules 230 and 330 may be 

collectively integrated in varying degrees, depending upon the particular application. 
For example in a satellite broadcast application, the multi stage multistage encoder, 
protocol converter (if employed), and transmit module may be located within a single 
appliance at the satellite ground station and/or on-board a spacecraft transceiver. In 

30 another embodiment, the encoder and transmit module may be separately located. 
Those skilled in the art will appreciate integrated systems of varying configurations 
are envisioned under the present invention. 

[0040] The foregoing are only exemplary of the systems and methods for 
generating and transmitting information additive coded data. Further embodiments 
35 are described in the commonly assign e d U.S. Pat e nt Application no. 10/032,1 56, 

entitled "Multi stage Code G e n e rator and Decod e r for Communication Syst e ms," and 
U.S. Patent Application no. 10/076,623, e ntitl e d "Information Additiv e Code 
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5 Generator and Decoder for Communication Systems," each incorporated by 
r e f e r e nce. R aptor and Lubv I. 

Pre-Encoding Data Segmenting and Loading 

[0041 ] In some embodiments of the present invention, the process of broadcasting 
data from a transmitter to one or more receivers using information additive codes in 
10 accordance with the present invention is subdivided into several s«b- 

processes subprocesses generally defined as an upload phase, a preparation phase, a 
transmission phase, a decoding phase, and a storage phase. 

[0042] The upload phase is the period in which the data is uploaded onto the 
encoding server. The encoding server can be any device capable of storing an 

15 appropriate amount of data, performing computations on the stored data, and sending 
the data to one or more clients. In some applications, the upload phase of the data 
may be negligible, for example when the data is directly created on the transmitting 
server. In other applications, the upload phase may be substantial, for example when 
the data is created and stored on an external storage device and has to be transported 

20 to the transmitting server. 

[0043] Once the upload phase is completed, the data may need to be prepared for 
encoding. For example, mwhen an information additive coding system as described 
in Raptor is used, it may be desirable to preprocess the data and compute static 
encoding symbols before the transmission commences. Where traditional FEC 
25 schemes are used, it may sometimes be desirable to compute a part, or all of the 

encoding symbols before they are transmitted. The phase between the completion of 
the upload and the commencement of the transmission is referred to as the preparation 
phase. 

[0044] The transmission phase is the period in which encoding symbols are 
30 transmitted to the recipient(s). In some cases, encoding may continue during the 
transmission phase. For example, this could be the case when information additive 
codes are used. The encoding symbols may be transmitted using the User Datagram 
Protocol (UDP) via unicast, or multicast, if applicable. 

[0045] Decoding of the received information may be triggered if some or all of the 
35 required number of encoding symbols are received by the client. For example, where 
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5 information additive coding is used as explained in Luby I or Raptor, the decoding 
may be triggered when an amount of encoding symbols is received that is slightly 
larger than the original amount. In other embodiments the decoding may be triggered 
when a substantially smaller amount of encoding symbols are received. The decoding 
phase is the period between the commencement of the decoding procedure and the 
10 complete recovery of the data, in case of successful decoding, or, if decoding is not 
possible, an indication that decoding is not possible and termination of the decoding 
process. 

[0046] Once decoding is complete, the data may be stored on a storage device 
which may be located r emotel y located from the client. For example, the data can be 
1 5 stored on a shared data server so it can be commonly used by a number of users. In 
that case, the decoded data is transferred to the storage device. The storage phase is 
the period between the termination of the decoding process, and the commencement 
of the storage process on an external storage device. 

[0047] The upload, preparation, decoding, and storage phase of a data transmission 
20 scheme using some form of information additive coding may increase the total 

transmission time. The time needed for each of these steps may depend substantially 
on the size of each encoding section (an encoding section is a piece of the data that is 
being encoded). In some applications, this piece can be the entire data. In other 
applications, the piece may be substantially smaller. 

25 [0048] The time added to the raw transmission time by the phases of upload, 
preparation, decoding, and storage can be a small fraction of the total transmission 
time. This is true, for example-toe i where the link between the server and the client 
admits only low speeds, whilewhereas the link between the storage device and the 
transmission server as well as the link between the client and the final storage device 

30 for the data is very fast, and the computing resources on the transmission server and 
the client allow for very fast preparation and decoding. 

[0049] In some cases the additional time spent for upload, preparation, decoding, 
and storage make up a substantial fraction of the total transmission time. For 
example, in a transmission scenario where the data to be transmitted resides on a 
35 server different from the transmission server, and the link between the transmission 
server and the storage server is a 100 megabit per second (Mbps) link, then the upload 
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5 time for a file of size 500 megabytes (MB) is 40 seconds. If the speed of the 
preparation phase is also 100 Mbps, then the preparation phase also requires 40 
seconds. If the link between the transmitting server and the client admits a 
transmission rate of 50 Mbps, and the data is sent to the client via UDP without 
employing rate control, then the transmission time of the file is at least 80/(1 -p) 

10 seconds, wherein p is a real number between 0 and 1 indicating the percentage of 

symbols lost during transmission. For example, if p is 1%, then the transmission time 
is at least 80.81 seconds. If the speed of the decoding is also 100 Mbps, then the 
decoding step requires 40 seconds as well. Assuming that the client may be able to 
transmit the decoded file to the external storage device at a speed of 100 Mbps, the 

15 storage phase adds an additional 40 seconds to the transmission time. If encoding is 
not performed substantially concurrently with the uploading, decoding is not 
performed substantially concurrently with the reception, and storage is not performed 
substantially concurrently with the decoding, then the various phases of the 
transmission add up to 240.81 seconds, of which only 80.81 seconds is the real 

20 transmission. The raw transmission time is increased by a factor of almost 3. Thus, 
in some embodiments of the invention, a system and process is useful in reducing the 
aforementioned upload, preparation, decoding, and storage processes. 

[0050] Fig. 4A illustrates a simplified block diagram of an improved encoder 400 
in accordance with one embodiment of the present invention. The improved encoder 
25 400 includes a control unit 402, a cache unit 410 and an encoding engine previously 
described as the single or multi s tag e multistage encoders 2 1 0 or 3 1 0, respectively. 

[005 1] The cache unit 410 is operable to retrieve parts of the data 105 and provide 
it to the encoding engine 210/310 for encoding. The size of the parts retrieved 
constitutes the size of a section encoded by the encoding engine, and may be 
30 communicated to the control unit 402 which forwards the information to the client via 
the out-of-band communication. 

[0052] In one embodiment, encoding is performed on a part of the data 105, while 
another part is retrieved into cache unit 410. Various types of resources needed for 
performing the encoding scale with the size of the encoding section. Such resources 
35 may include computational resources, and memory resources. By reducing the size of 
each encoding section, the total demand for resources on the server decreases. 
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5 [0053] Fig. 4B illustrates a first embodiment of the improved encoder 400 in 
accordance with the present invention, with previously identified features retaining 
their reference numerals. As shown, the cache unit 410 includes an upload unit 412, 
and two data buffers 414 and 416, the size of which is chosen so that each holds two 
consecutive segments S(n) and S(n+1) of the data 105. Those skilled in the art will 
10 appreciate that any number and/or size of buffers may be chosen in other 
embodiments of the invention. 

[0054] During operation, the data file or stream is subdivided into sections S(l), 
S(2), etc. If data 105 refers to a stream, not all of the sections may be available at the 
time of transmission. In the following descriptions of whether an operation is 
15 performed on a section, it is implicitly assumed that the section is available at the time 
when the operation is performed. If not, the operation will wait for the section to 
become available. 

[0055] In one embodiment the sizes of all sections, except possibly the last, are 
equal. In another embodiment, the sizes of the different section may be substantially 

20 different. In one embodiment, the size of each section can be computed by the upload 
unit 412 and communicated to the control unit 402 and the encoding engine 210/310. 
In another embodiment the size of the sections can be selected by the operator and 
communicated to the control unit 402 and encoding engine 210/310. In another 
embodiment, the size of the sections can be selected by the operator and 

25 communicated to cache unit 810, for example via an application program interface 
(API). In yet another embodiment, the control unit 4 10 402 computes the sections 
sizes and communicates it to the upload unit 412, and the encoding engine 210/310. 

[0056] After determining the size of each section, the upload unit 412 retrieves the 
first section S(l) of the data 105 and stores it in the buffer 81 6 . 416. Once storage is 

30 complete, that section is forwarded to the encoding engine 210/310 for encoding. At 
the same time, the next section S(2) is retrieved and put into the buffer 414. The 
encoding engine 210/310 generates encoded data for the first section. It may 
terminate the process when instructed by the control unit 402. The same termination 
message may also be sent to the upload unit 412. At this point, the upload unit 412 

35 may forward the contents of buffer 414 to the encoding engine, retrieve section S(3) 
from the data 105, and put it into buffer 416. The encoding engine continues 
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5 generating encoded data for S(2) until instructed by the control unit 402 to stop. In 
general, eae once the encoding engine 210/310 and upload unit 412 receive an 
instruction from the control unit 402 to terminate encoding section S(n-1), section 
S(n) is forwarded to the encoding engine and section S(n+1) is retrieved from data 
105 and buffered. The process may continue indefinitely, or until kupload unit 412 is 
10 instructed by the operator or other external signal to stop, or continue until all of the 
data 105 has been transmitted. 

[0057] In one embodiment in which the recipient wishes to receive only parts of 
the data 105 exactly, some sections of data 105 may be transmitted without coding, 
while others may be coded. For example, where data 105 corresponds to a live 
15 stream, and the source coding method used for digitization allows for layering the 
data into parts of various levels/sections, such an embodiment could be used to 
encode the-some levels/sections while sending other levels/sections without coding. 

[0058] Fig. 4C illustrates a second embodiment of the improved encoder 400, 
comprising a multiple engine encoder. The multiple-engine encoder 400 is comprised 
20 of two engines El andE and E 2, embodiments of which are described in Figs. 2 A and 
3 A above. While two encoding engines are shown, a larger number of engines may 
be used in alternative embodiments under the present invention. 

[0059] Upon initiating a-download, the cache unit 410 fetches the first section S(l) 
and forwards it to encoding engine El for encoding. At the same time, it fetches S(2), 

25 and forwards it to encoding engine E2 for preparation of encoding. Encoding engine 
E2 could also start encoding section S(2) and storing encoding information into a 
buffer for future transmission. Once the 'done message' for section S(l) is received 
by control unit 402, it may instruct the encoding engine El and the upload unit 412 to 
drop Section S(l). Upon receiving this request, the upload unit 412 instructs E2 to 

30 start encoding section S(2); alternatively, if encoding information has already been 
generated, it could be supplied to the protocol converter (if required) and 
subsequently to the transmit module . At the same time, section S(3) is fetched from 
data 105, stored in buffer 415, and forwarded to encoding engine E2. Similarly, 
encoding engine E2 prepares section S(3) for encoding, or, in case of availability of 

35 memory, starts encoding section S(3) and storing encoding information into a buffer 
for future transmission. In general, encoding engine E2 encodes sections with an 
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5 even index 2n, and encoding engine El encodes sections with an odd index 2n+l, 
wherein n is an integer greater than or equal to 1 . Once section S(2n-1) is finished, 
encoding engine E2 starts encoding section S(2n), and the upload unit 8+3412 fetches 
section S(2n+1) (if it exists) and forwards it to encoding engine El for preparation for 
encoding. Similarly, once section S(2n) is finished, encoding engine El starts 
10 encoding section S(2n+1), and the cache unit fetches section S(2n+2) and forwards it 
to encoding engine E2 for preparation for encoding. 

[0060] The foregoing example is for illustrative purposes only, and additional 
buffers may be used in alternative embodiments under the present invention. For 
example, in the case of three buffers, the first one would be used to produce encoding 
15 symbols for section S(3n-2), while the second one would be used to prepare section 
S(3n-1) for encoding, and at the same time, section S(3n) would be uploaded into the 
third data buffer. The larger number of buffers may lead to a further decrease of 
upload, preparation, and decoding times. 

[006 1] As mentioned above, the size of the sections S(l), S(2), . . . depends on a 
20 number of parameters. On the one hand, the sections chosen should not be chosen too 
small, since this may lead to inefficiencies in the transmission. For example, where 
the channel has a round trip time (RTT) of 250 milliseconds (ms) . Then ,, each section 
is served for 250 ms longer than is needed. If the channel has a bandwidth of 10 
Mbps, then this translates to 320 kilobytes (KB). If the section size is less than this 
25 amount, then at least 50% of the bandwidth in channel 155 is wasted. To keep the 
wasted bandwidth at 1 % or less, the section size needs to be more than 3 1 megabytes 



[0062] In some embodiments of the present invention, the delay incurred by late 
reception of the 'done message' may be substantially reduced by transmitting a 

30 section at a rate that varies over time. The exact variation of the transmission rates 
depends on the application. In one embodiment, the rate at which the first section is 
served could decrease over time, and at the same time, the rate at which the second 
section is transmitted is increased over time. Once the 'done message' for the first 
section is received, the first section is dropped and the process is continued continues 

35 with sections 2 and 3, and so forth. The number of sections served substantially 



(MB). 
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5 concurrently is not limited by two, but could take on any value, as long as the 
resources on the server would allow that. 

[0063] -WfeAt e Although very small section sizes may lead to transmission 
inefficiencies, sections of too large a size could lead to a waste of server and client 
resources, and could add an additional delay to the transmission. For example, 

10 suppose that the data transmitted is a-data of size 500 MB, that the section size is 50 
MB, that the connection between a server and a storage device storing the data has a 
bandwidth of 100 Mbps, that the preparation speed for the section is also 100 Mbps, 
and that the connection between client and the storage device storing the data has a 
bandwidth of 100 Mbps. Then the total transmission time for the data is equal to the 

15 time to upload, prepare, decode, and store one section, plus the time needed for the 

transmission of the entire data. With 1% loss, the latter equals 80.81 seconds, and the 
former equals 16 seconds, leading to a total transmission time of 96.81 seconds. If the 
section size is 100 MB, then the delay caused by uploading, preparing, decoding, and 
storing a section is proportionally larger and equal to 32 seconds, leading to a total 

20 transmission time of 1 12.81 seconds. 

[0064] Large sections could also add to the amount of memory used by the server 
and by the client. For reasons of speed, it is advantageous to perform the encoding 
and decoding operations in the Random Access Memory (RAM) or other fast access 
memory devices on the server and on the client, rather than reading from and writing 
25 to disk. In such an embodiment, the server and the client preferably include enough 
memory to store at least the amount of two sections. To keep the memory resources 
low, the section sizes need thus to be chosen appropriately. 

[0065] Various methods can be used to decrease the memory requirements on the 
server and on the client. On the client side one embodiment of such a method is the 

30 following: while decoding the section S(n-l), the space freed by the decoded content 
is used to store incoming encoded information about section S(n). Under favorable 
conditions with respect to the decoding speed and the transmission speed, the memory 
requirement for the client side can be decreased by a factor of 2. Other methods using 
sophisticated interleaving techniques similar to those in the aforementioned US Patent 

35 Application No. 10/3 67,5 73 described in Rasmussen can be employed to reduce the 
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5 memory requirements on the server and the client side, as will be apparent to those 
skilled in the art upon studying tkis Rasmussen document and its references. 

[0066] In one embodiment of the present application the section sizes are chosen 
to have different sizes. For example, where the server can upload data faster than it 
can transmit, it is possible to use section sizes that grow over time to facilitate faster 

10 start up times on the server. For example, the methods provided in U.S. Pat e nt 

Application No. 09/768,8 4 3, fil e d 1/23/2001 and entitl e d "Methods and Apparatus for 
Sch e duling, Serving, Receiving Medio -on D e mand For Cli e nts, Server s Arrang e d 
According to Constraints and R e sourc e s" (ref e rr e d to as 'MOD'O MOD may be used 
to compute various section sizes and scheduling algorithms for their activation. The 

15 different section sizes can also be used to support multiple clients that experience 
different fractions of losses. For example, recipients could select which sections to 
receive in a similar way as described in MOD, except that only a limited number of 
sections are serving at the same time. Then the fact that the section sizes are growing 
improves the chances that multiple recipients receive concurrently from the same 

20 sections towards the end of the transmission. In particular, in a configuration where 
the recipients start receiving at the same time, if recipients have a maximum loss rate, 
then the section size growth can be calculated to ensure that at any point in time only 
a small number of sections needs need to be served concurrently. 

[0067] For example, in a case where the next section size is a factor of a larger 
25 than the previous one, with a being a real number larger than or equal to one, and 
where each client experiences a maximum loss rate of 20%, then if a is chosen to be 
at least 1.25, and the sections are transmitted using a chain reaction coding system or 
a traditional FEC code with a rate of at most 0.8, and where the clients commence the 
download at the same time, then it can be shown that the server needs to e»ly 
30 broadcast only two sections at a time to ensure that all clients receive the entire 
content. The results of MOD can be used to obtain good sectioning schemes in 
scenarios where the server resources or the client resources, e.g., memory or CPU 
speed, are constrained. 

Post-Encoding Processes 
35 [0068] In applications where the transmission and delivery of a live data stream is 
desired, the aforementioned encoding processes may be modified or augmented in 
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5 order to reduce latency in the coding and decoding processes. Specific systems and 
methods for reducing latency are described in th o commonly a ss ign e d US Pat e nt 
Application No. 10/367,573 entitled "Systems and Methods for Reliably 
Communicating the Cont e nt of a Live Data Stream," which is incorporated h e rein by 
r e ferenc e . Rasmussen. 

10 [0069] Fig. 5 A illustrates a general encoding process which may be used in system 
broadcasting live streaming data. Initially, the live data stream is partitioned into 
time-ordered segments So, Si, S2, . . - 4 with common duration t seconds and common 
length K AMBs. (The live data stream may not naturally be in the same format as the 
transmission medium, but we may use the same units without loss of generality.) The 

15 data partitioning may include those processes described in Figs. 8A-C below. 

[0070] Subsequently, an FEC (forward error/erasure correction) code, such as 
information additive coding, is applied separately to each Si, the output of the code 
denoted Ei. Each E, has length N AMBs. The N AMBs for E 0 are transmitted on the 
medium, followed by the N AMBs for E r , etc. At the time when segment Si is to be 

20 recovered, some fraction of the AMBs of E, are available. The FEC code guarantees 
that if L of the AMBs are available, Si can be recovered. The value of L is a property 
of the particular coding employed. Reed-Solomon codes have the desirable property 
that L = K; however, the complexity of decoding necessitates small values for K and 
N. Information additive codes as described in Luby I and Raptor have L slightly 

25 larger than K and low complexity of decoding. 

[0071] Fig. 5B illustrates a specific embodiment for encoding the process for a live 
data stream in accordance with the present invention. The process begins at 571, 
when the first segment So containing first segment data is received. Next at 572, a 
forward error correction algorithm is applied to the first segment data to produce a 

30 first transmit block T 0 containing the FEC-encoded first segment data. In a specific 
embodiment, the FEC employed is information additive codes, as described and 
incorporated herein. In the signal timing diagram of Fig. 5C, the applied forward 
error correction coding outputs the FEC-encoded segment data after all of the first 
segment data is received. In an alternative embodiment, the FEC-encoded data is 

35 produced as the segment data is being received. 
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5 [0072] At 573, first transmit block T 0 is sub divided subdivided into two or more 
blocks. In the exemplary embodiment of Fig. 5C, the first transmit block T 0 is sub- 
divide dsubdivided into three blocks T 0a , T 0 b, and T 0c . In the preferred embodiment, 
sub - block s subblocks T 0a , T 0 b, and Tqc each comprise distinct data, i.e., they contain 
minimal, if any, common data. Next at 574, a first of the two or more sub- 
10 bteek ssubblocks is transmitted on a first main sub chann e l subchannel . As shown in 
Fig. 5C, the first s ub block subblock T 0a is transmitted on a first main sub- 
channel subchannel 506Mi. 

[0073] Next at 575, the second segment Sicontaining first segment data is 
received. A forward error correction algorithm is subsequently applied to the second 
15 segment data to produce a first transmit block Ti containing the FEC-encoded second 
segment data (process 576). At 577, the second transmit block Ti is sub- 
divided subdivided into two or more blocks, which, in Fig. 5C consists o f comprises 
three blocks T Ja , Ti b , and Ti c . As above, sub blocks subblocks Ti a , Ti b , and Ti c each 
preferably comprise distinct data. 

20 [0074] At 578, the second sub block subblock T 0 b is transmitted on the first main 
sub channel subchannel 506M] substantially concurrent with the transmission of the 
first sub bloc k subblock Ti a on the second main sub chann e l subchannel 506^1^ At 
579, there is the concurrent transmission of Ti a on the first booster sub- 
channel subchannel 506Bi and T^a on the second booster sub channel subchannel 

25 506B 2 . 

[0075] As the signal timing diagram of Fig. 5C illustrates, the aforementioned 
process may be repeated for additionally received segments S2-S7, in which each 
segment is received, forward error corrected to a transmit block T2-7, each transmit 
block divided into two or more sub blocks subblocks , and the sub blocks subblocks 
30 transmitted on the main and booster sub channels subchannels as shown. In the 

preferred embodiment, the number of sub divided subdivided blocks determines the 
number of receiver and booster sub channels siibchannels , the total bandwidth of 
which equals the reception rate 509. 

[0076] In the particular embodiment of Fig. 5C, a first s ub block subblock 
35 sequence, T ia , i.e., Ti a , T 2a , T 3a , . . . is transmitted along the first booster sub- 

channel subchannel 506Bi. As further illustrated, the first s ub block subblock transmit 
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5 sequence one block delayed, i.e., T 0a , Ti a , T 2a , T 3a , . - - is transmitted along the 
second booster sub chann e l subchannel 506B 2 The third booster channel 506B 3 
transmits a second s ub block subblock sequence Tib, i.e., T 0 b> Ti b , T 2 b, T 3b , . . . 

A receiver in the system may have sufficient bandwidth to simultaneously monitor 
both the main channel 506M and the booster channel 506B. In another embodiment, 
10 the receiver channel is limited, for example, by its particular design, by network 

congestion, or by signal interference to monitor only one channel. In the latter case, 
the receiver is preferably configured to monitor the booster channel 506B initially, 
and can switch its reception to receive transmits transmit blocks Ti either on the 
booster channel 506B or on the main channel 506M. 

15 [0077] During reception, the receiver listens to the booster channel 506B for the 
first transmit blocks, which consists o f comprises T 0a , Tob and Ti a in the time slot 554. 
The receiver subsequently switches to the main channel 54- Q506M to receive transmit 
blocks T 0c , Ti bi -T 2a during the next transmit slot 555. The corresponding pieces of 
the received sub divid e d subdivided data are assembled, e.g., To c , Ti b & Ti c , T 2a , .... 

20 and FEC-decoded to recover the corresponding segment data. As illustrated, 

transmissions over the first and second time slots 554 and 555 will result in two-thirds 
of the second transmit block Ti data being recovered (Ti a & Tib), which may be 
sufficient to recover the data contained within corresponding segment block S\. As 
the process continues in time slots 556 and beyond, the later z occurring transmit sub- 

25 bleeks subblocks T 2 j, T 3 j, etc. will be received, the transmit blocks T 2 , T 3 , etc. 

reconstructed, and the data contained within their corresponding segments S 2 , S 3 
recovered. 

[0078] The foregoing is only exemplary of the systems and methods for processing 
information additive codes for transmission and reception. Further embodiments are 
30 described in the commonly assigned application US Patent Application No. 

10/367,573 e ntitled "Syst e ms and Method s for R e liably Communicating th e Content 
of a Liv e Data Stream/' incorporat e d h e rein by reference. Rasmussen. 

Exemplary Broadcast Receivers and Processes 

[0079] Fig. 6A illustrates a first embodiment of the receiver 130, comprising a 
35 single ^stage information additive code receiver in accordance with the present 

invention. The term "receiver" is used generically to refer to the unit's function, and 
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5 may comprise a network client, computer peripheral, a radio, PCMCIA card, cable 
modem, satellite radio receiver, network device, a GPS-based car navigation receiver, 
set-top-box, home network gateway, or any such unit which is configured to receive 
and process the coded information as described herein. 

[0080] The receiver 130 functions compl e m e ntar v complementarilv to the single- 
10 stage transmitter of Fig. 2 A above and includes a receive module 610, a protocol 

converter 620, and a single-stage decoder 630. The receive module 610 is operable to 
receive the coded transmission 115 and recover therefrom the output symbols and, 
when present, data a&4 eabout the transmitted keys. The receive module 610 
comprises that hardware, software, firmware or a combination thereof needed to carry 
15 out these functions and may comprise, for example, a signal collection means (e.g., an 
antenna, optical lens/telescope, cable modem, network interface card, 802. 1 lx radio 
card, etc.), front-end electronics, and a demodulator to recover the output symbols and 
key data. 

[008 1 ] The protocol converter 620 receives the output symbols and key data, and 
20 formats each to the protocol appropriate for the particular receiver system. 

Exemplary receiver protocols include TCP/IP, UDP/IP, MPEG2-TS, or other network 
or communication system protocols. In alternative embodiments in which the 
protocol of the recovered output symbols and key data do not require reformatting, the 
protocol converter 620 is omitted or bypassed. 

25 [0082] The single z stage decoder 630 and corresponding method of operation are 
generally as described in Luby I, the contents of which is incorporated by reference. 
As shown, a key regenerator 631 receives key data and regenerates the keys for the 
received output symbols. Symbol decoder 632 uses the keys provided by key 
regenerator 66 0631 together with the corresponding output symbols, to recover the 

30 input symbols (i.e., IS(0), IS(I), IS(2), etc). Symbol decoder 632 provides the 

recovered input symbols to an input file reassembler 633, which generates a copy of 
input file or stream 105. 

[0083] Fig. 6B illustrates a method of recovering input symbols from a coded 
transmission using the receiver shown in Fig. 6A in accordance with one embodiment 
35 of the present invention. At 652, the receiver receives one or more output symbols, 
each output symbol being generated from one or more input symbols from an order 
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5 set of input symbols. Preferably, at least one output symbol is generated from a set of 
at least two, but fewer than all of the input symbols in the ordered set of input 
symbols. Purther More preferably as described above, the number of possible output 
symbols is much greater than the number of input symbols in the ordered set. At 654, 
the ordered set of input symbols is regenerated from a received set of N output 
10 symbols. Preferably, N is greater than one, but much smaller than the number of 
input symbols in the ordered set. 

[0084] Fig. 7 A illustrates a second embodiment of the receiver 130 comprising a 
multi stage m ultistage information additive code receiver in accordance with the 

15 present invention. The receiver 130 functions complem e ntary complementarily to the 
transmitter of Fig. 3 A and is constructed similarly to the single stage receiver 
illustrated in Fig. 4 A above. The multi stage multistage receiver 130 similarly 
includes a receive module 710, a protocol converter 720, and a multi stage multistage 
decoder 730. The receive module 710 and protocol converter 720 operate in much the 

20 same manner as described above in Fig. 6A. The multi stage multistage decoder 730 
employs a two z stage coding scheme as described in the Raptor, incorporated herein 
by reference. 

[0085] During decoder operation, key data information is provide provided to the 
dynamic key regenerator 731, which, in response, regenerates dynamic keys I a , lb, etc. 

25 The static key generator 733 produces static keys So, Si, etc. in response to a seed 
value supplied to it by the random number generator 734. Output symbols B(Io), 
B(Ij), etc., dynamic keys I a , lb, etc., static keys So, Si, etc., and values K and R are 
provided to the symbol decoder 732 732, which, in response, produces input symbols 
IS(0), IS(1), etc . The input symbols are supplied to a data reassembler 735 which 

30 r e constructs substantially reconstructs a copy of the original data file or stream. 

[0086] Fig. 7B illustrates one embodiment of the symbol decoder 732 in 
accordance with the invention. The symbol decoder 732 includes a dynamic decoder 
732a, a static decoder 732b, and a reconstruction buffer 732c. The dynamic decoder 
732a receives the output symbols B(I a ), B(Ib), etc. and the dynamic keys I a , lb, etc. In 
35 response, the symbol decoder 732 attempts to reconstruct the input symbols IS(0)- 
IS(K-1) and redundant symbols RE(0)-RE(R-1). Input and redundant symbols 
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5 recovered by the dynamic decoder 732a are stored in the reconstruction buffer 732c. 
Upon completion of dynamic decoding, the static decoder 732b attempts to recover 
any input symbols not recovered by the dynamic decoder 732a. In particular, the 
static decoder 732b receives input and redundant symbols from the reconstruction 
buffer 732c, and static keys S 0 , Si, etc. from the static key generator. The recovered 
10 input symbols stored in the reconstruction buffer 732c are supplied to the input data 
assembler 735. 735 (of Fig. 7 A). 

[0087] Fig. 7C illustrates a method of recovering input symbols from a coded 
transmission using the receiver shown in Fig. 7A in accordance with one embodiment 
of the present invention. At 752, the receiver receives one or more output symbols, 

1 5 each output symbol being generated from one or more symbols from a combined set 
of input symbols and redundant symbols. Preferably, at least one output symbol is 
generated from a set of at least two, but fewer than all of the symbols in the combined 
set of input and redundant symbols. Furth e rM ore preferably as described above, the 
number of possible output symbols is much greater than the number of symbols in the 

20 combined set of input and redundant symbols. At 754, at least a subset of the 

combined set of input and redundant symbols is regenerated from a received set of N 
output symbols, whereby the combined set includes regenerated input symbols and 
regenerated redundant symbols. At 74& J56, some of the unregenerated input 
symbols may be regenerated from regenerated redundant and input symbols if the 

25 previous step 754 does not result in the regeneration of the input symbols to a 
predefined degree of accuracy. 

[0088] As described above with respect to the broadcast transmitter embodiments, 
the receive modules, protocol converters, and decoders may eaeh-be individually 
realized in a variety of diff e r e nt forms, such as in hardware, in software/firmware, or 
30 a combination of these components and in varying degrees of integration, depending 
upon the particular application. 

[0089] The foregoing are only exemplary of the systems and methods for receiving 
and decoding information additive coded data. Further embodiments are described in 
the commonly assigned U.S. Patent Application no. 10/032,156, entitled "Multi stage 
35 Code G e nerator and D e cod e r for Communication Syst e ms; 9 and U.S. Patent 
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5 Application no. 10/076,623, entitled "Information Additiv e Codo Generator and 
Poofter for Communication iSyfltems. < " each incorporat e d by r e ferenc e . Raptor. 

Inactivation Decoding 

[0090] In one embodiment of the receiver's decoding processing, decoding starts 
by identifying an "output symbol of degree one." The term "output symbol of degree 

10 one" refers to an output symbol associated with only one source (i.e., input) symbol. 
Similarly, an output symbol associated with two source symbols would be referred to 
as an output symbol of "degree two." Source symbols are referred to in a similar 
manner corresponding to the number of output symbols each source symbol is 
associated with. An output symbol and an input symbol are described as "associated" 

15 if the value of the input symbol is used to obtain the value of the output symbol. The 
mathematical operation which defines this association may be any particular 
operation, and in one embodiment, the output symbol's value is the XOR of the 
values of some of the source symbols. 

[0091] Once the output symbol of degree one is identified, the associated source 
20 symbol is recovered and is removed from the decoding process. The process 
continues by identifying another output symbol of degree one. The process is 
continued until all the source symbols are recovered, or until there is no output 
symbol of degree one. 

[0092] This decoding process may encounter difficulty when no output symbol of 
25 degree one is found. In some instances, the decoding process may stop prematurely 
and the decoder may flag an error. Alternatively, the decoder may use other more 
elaborate algorithms like Gaussian elimination to complete decoding, if possible. 
However, the running time of Gaussian elimination may be prohibitively iargelong for 
applications where fast decoding is desired, especially when the number of 
30 unrecovered input symbols at the time when no more output symbols of degree one 
are found is large. This would lead to a decoding algorithm whose computational 
overhead is substantially larger than the information additive decoder, and may 
therefore be undesirable in certain applications. 

[0093] Fig. 8 A illustrates a method for decoding the information additive codes 
35 using inactivation in accordance with one embodiment of the present invention. The 
processes included in the exemplary decoding routine 800 include a start-up process 
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5 810, a source symbol selection and deactivation process 820, and a source (i.e., input) 
symbol value recovery process 830. These processes are described in greater detail in 
tho commonly assigned US Patent Application No. 10/ 4 59,370 entitled "Systems and 
Methods for Decoding Chain R e action Cod e s Through Inactivation," which is h e r e in 
incorporated by r e ferenc e . Shokrollahi. 

10 [0094] Fig. 8B illustrates one embodiment of the start-up process 810 illustrated in 
Fig. 8 A. Initially at 81 1, a determination is made as-te-whether any output symbols of 
degree one are present. If so, the source (i.e., input) symbol associated with the 
output symbol is recovered at 812. The process then returns to 81 1, where a 
subsequent determination is made a&4e~whether any other output symbols of degree 

15 one remain in the code. If at 81 1 no output symbols of degree one remain, the process 
proceeds to the source symbol selection and deactivation process 820. 

[0095] Fig. 8C illustrates one embodiment of the source symbol selection and 
deactivation process 820 illustrated in Fig. 8 A. Initially at 821, an active source 
symbol is selected which is associated with an output symbol of degree two or higher 

20 (i.e., an output symbol associated with two or more source symbols). The maimer by 
which a particular source symbol is selected from among a number of similar source 
symbols is described in the aforementioned US Patent Application No. 
10/ 4 59,370. Shokrollahi. Next at 822, the particular source symbol selected is 
deactivated. Subsequently at 823, a determination is made as4e-whether any output 

25 symbols of degree one exist for decoding. In some embodiments, the preceding 
deactivation will produce one or more output symbols of degree one. In other 
embodiments, the preceding deactivation will not result in an output symbol of degree 
one. In the late r! atter case, the process repeats the process steps of 821-823. 

[0096] If the deactivation process of 822 does result in the production of one or 
30 more output symbols of degree one, the process continues at 824 where one of the 
source svmbol svmbols associated with an output symbol of degree one is declared 
recoverable. The process then returns to 823 where a determination is made-as4e 
whether any additional output symbols of degree one remain. The processes of 823 
and 824 are repeated until all of the output symbols of degree one produced by the 
35 preceding deactivation process are declared recoverable. 
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5 [0097] If the deactivation of the selected source symbol at 822 does not result in 
the an output symbol of degree one, or once all of the output symbols of degree one 
are declared recoverable at 824, the process continues from 823 to 825, where a 
determination is made-as-4e whether any source symbols associated with output 
symbols of degree two or higher remain. If so, the process returns to 821 where 

10 another active source symbol of degree two or higher is selected, deactivated, and the 
presence of output symbols of degree one is checked. One or more iterations of the 
processes may occur, for instance, where the deactivation of a first source symbol of 
degree two or higher does not result in an output symbol of degree one, but additional 
source symbols of degree two (or higher) remain. In this case, the subsequent 

15 deactivation of another source symbol of degree two (or higher) may produce one or 
more output symbols of degree one. The process repeats until all source symbols 
have been either been recovered (via the start-up process 810), deactivated (via 822), 
or declared recoverable (via 825), at which point the process proceeds to the source 
symbol value recovery process 830. 

20 [0098] Fig. 8D illustrates one embodiment of the source symbol recovery process 
830 illustrated in Fig. 8A. Initially at 832, the values of one or more source symbols 
deactivated in 822 are recovered. In a specific embodiment, for instance in which 
Gaussian elimination is used in the decoding process, all values of deactivated source 
symbols are recovered in this process. Subsequently at 834, the values of one or more 

25 source symbols declared recoverable in process 825 are determined using the 

recovered values of the deactivated source symbols. In one implementation, such as 
the aforementioned process in which Gaussian elimination is used, the values of all 
recoverable source symbols are determined in this proc e ss . In alternative 
embodiments of 832 and 634 ?834, the values of one or more, but fewer than all of the 

30 recoverable source symbols are determined. This may be advantageous when, for 
reasons of necessity, expediency, cost, etc., a complete decoding of the information 
additive code is not required or possible. 

[0099] The foregoing is only exemplary of the systems and methods for decoding 
information additive codes through deactivation. Further embodiments are described 
35 in th e commonly a s signed US Pat e nt Application No. 10/459,370 entitled "Systems 
and Proc e ss es for D e coding Chain R e action Cod e s Through Inactivation," 
incorporat e d bv r e f e r e nc e . Shokrollahi. 
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5 Announcement and Previous Program Channels 

[01 00] In a particular embodiment of the invention, receivers are informed as 
teabout future broadcast transmissions vi aby session description data. Session 
description data may include a description of the upcoming transmission, the expected 
day/time of the transmission, and file size of the transmission. The session 
10 description data may be communicated on a dedicated announcement channel within 
the broadcast system (for example, the secondary channel or a channel similar 
thereto), or it may be multiplexed with the source data along the primary channel. 

[0101] In another embodiment, source data belonging to a previous data 
file/stream is broadcast in order to allow those receivers which did not obtain the 
1 5 threshold quantity of coded transmission to recover the previous data file/stream. 
Coded transmissions corresponding to a previous program may be broadcast on a 
separate channel (perhaps at a low data rate so as not to too greatly reduce the data 
rate of the primary and/or announcement channels), or it may be multiplexed with the 
source and/or announcement data. 

20 Exemplary Applications and Systems 

[01 02] As noted above, the properties of the information additive codes are ideally 
suited for many broadcast applications, the requirements of which have been only 
minimally met by present day systems. Conventional broadcast systems which 
disseminate large data files using a data carousel protocol suffer from protracted 

25 transmission periods, as signal transmission must be repeated until a high probability 
exists that most terminals hashave received each specific segment of data. When it is 
considered that the receiving terminal may be intermittently- available (e.g., a car 
which stops receiving when the ignition is switched off, or which looses signal 
reception within a tunnel), an even longer broadcast period must be undertaken. 

30 [0103] Broadcast systems employing information additive coding avoids these 

shortcomings, as one of the code's properties is that only a threshold quantity of code 
segments need be decoded in order to recover the entire encoded file. The receiving 
terminal need only receive a particular threshold amount of data to recover the file, 
and data received during any reception period will contribute toward that threshold. 

35 As a result, broadcast time to these terminals is substantially reduced. 
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5 Solution for Broadcasting to Automobiles 

[01 04] Current in-car global positioning satellite (GPS) systems combine satellite 
positioning information with a DVD-based database. These databases include maps, 
routing information, and Point-of-Interest (POI) information data, including fer 
example, retail and services information , for example . Updates as to on routing and 

10 POI information must be constantly communicated to drivers if the navigational 
system is to be relied upon. Further, in-car navigation systems represent a primary 
platform for receiving large information and entertainment files such as current 
weather reports, audible books, movies, or information useful for the driver and 
passengers. Accordingly, in-car navigation systems operable to support these services 

1 5 would provide substantial value. 

[0105] Fig. 9 A illustrates one embodiment of the present invention comprising a 
satellite system 900 for broadcasting data, such as the aforementioned data and/or 
entertainment services, to a large number of vehicle-based terminals 920. The 
system 900 includes two transmitters, 906 being a satellite-based transmitter, and 916 

20 being a terrestrial-based transmitter. Satellite- bas e d transmitter 1 10 a system 900 
includes a server 902 which includes the above-described encoder 210/310 (and 
protocol converter 220/320 if needed), a satellite uplink 904, and a broadcast satellite^ 
based transmitter 906 configured to communicate data to vehicles within a first 
coverage area 930. TheA terrestrial-based transmitter-44-0b includes a second server 

25 912 which also includes the aforementioned encoder 210/310 (and protocol converter 
220/320 if needed), a transmission line 914, and a broadcast tower 916 operable to 
provide the coded transmission to vehicles within a second coverage area 940. The 
complementary use of terrestrial broadcast towers or other communication means may 
be advantageous to cover gaps or provide coverage in those areas where satellite 

30 coverage may be unable to reach. Coverage areas 930 and 940 are shown as 
overlapping, although gaps may exist between coverage areas in alternative 
embodiments under the present invention. 

[01 06] Several vehicles 920 are located within the coverage areas 930 and 940. 
Vehicles 920i and 9202 are in motion within coverage area 930 and receive the coded 
35 transmission 1 15a from the satellite-based transmitter 1 10a at the data rate provided 
thereby. Vehicle 9203 is parked with its ignition switched off, and as a result may not 
receive the coded transmission 1 15a. Optionally, Vehicle 92O3 includes a power 
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5 supply which continues supplying power to its receiver, thereby permitting it to 
continue receiving the coded transmission when parked. Vehicle 9204 is located in 
the overlapping regions of 930 and 940. Vehicle 920 5 is within the second coverage 
area receiving the coded transmission 1 15b at its transmission rate. 

[0107] Each of the transmitters 110 may comprise a single- or multi 
10 stagemuWstage encoders as described in Figs. 2 A or 3 A, respectively. In addition, 
the pre-encoding data segmenting process described in Figs. 8A-8C may be 
employed. Each of the receivers preferably includes a decoder of the same type (i.e., 
single^ or multi s tage multistage) used in the system's transmitter. Further, the 
decoder may employ the inactivation process as described above. In a particular 
15 embodiment, the receiver is powered by a 12 Vdc supply of other voltage supply 
provided by the v e hicles vehicle's battery, and is integrated within the navigation 
receiver. The receiver may include software executed within a flash-based 
microprocessor/microcontroller which controls the navigation system to perform the 
reception, protocol conversion and data decoding functions as described herein. 

20 Solution for Broadcasting to Mobile Handsets 

[01 08] Fig. 9B illustrates another embodiment of the present invention comprising 
a system for broadcasting live streaming data to a large number of mobile handset 
terminals. Live data may consist o f comprise news, financial information such as a 
stock ticker, a live sporting event, or some such similar content. 

25 [0 1 09] The system-950 includes a server 952 comprising an encoder (and protocol 
converter, if necessary), a communications backbone 954, and communication towers 
956 x (9563 shown as temporarily inoperable). Mobile terminals 958 x may be cellular 
telephones, computers able to receive the coded transmission 115 wirelessly via 
802.1 lx radio cards, personal digital assistants, or other similar wireless mobile 

30 terminals. The system 950 further includes a secondary channel 959, shown as a USB 
(universal serial bus) connection to which mobile terminal 9583 connects to receive 
the coded transmission 115. As above the encoder may comprise the single^ or multi 
stage multi stage encoder, and preferably includes the post-encoding data interleaving 
and partitioning processes described for live streaming applications in Figs. 7A-7C 

35 above. Further, the encoding processes may include the pre-encoding data 
segmenting process to further decrease transmission delay. 
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5 [Oil 0] Mobile receivers 95 8 X will preferably employ decoders (single- or multi 
stag emultistage ) matched to their system's encoder. In some embodiments, the 
decoding process will include the symbol deactivation processes described in Figs. 
68A-8D. The mobile handset may include software executed within a flash-based 
microprocessor which controls the handset to perform the reception, protocol 
10 conversion and data decoding functions as described herein. 

[01 1 1 ] While the aforementioned receivers have been described as mobile, in other 
embodiments the terminals will be stationary, for instance, where the receiver loses 
signal reception intermittently due to its location on the boundary of a covered area, 
or failure or relative movement of the broadcasting source. Further, the systems and 

15 methods of the present invention may be used to facilitate communication between 
any type of transmitter and receiver, not only to those receivers characterized as 
intermittently available. Those skilled in the art will readily appreciate that the 
features of the present invention can be equally and advantageously applied to 
receiving systems which are configured to continuously receive data, as well as to any 

20 broadcast system in which highly efficient communication to multiple receivers is 
desired. 

References Incorporated Her e i n 

10112] — Th e following references ar e her e in incorporat e d in th e ir entirety for all 
25 purposes: 

U.S. Patent No. 6,373, 1 06 e ntitl e d "Information Additiv e Code 
Generator and Decod e r for Communication Systems"; 

U.S. Patent Application No.09/768,8 4 3, entitl e d "M e thods and 
Apparatu s for Scheduling, S e rving, Receiving M e dia on D e mand For Cli e nts, S e rv e rs 
30 Arranged According to Constraints and R e sourc e s"; 

U.S. Pat e nt Application No. 10/032,156, e ntitl e d "Multi stage Code 
Gen e rator and D e cod e r for Communication Syst e ms"; 

U .S. Pat en t Appl i cation No. 1 0/076,623, entitl e d "Information 
Additiv e Cod e Gen e rator and Decod e r for Communication Syst e ms"; 
35 US Patent Application No. 10/367,573, entitl e d "Syst e ms and M e thods 

for R e liably Communicating th e Cont e nt of a Liv e Data Str e am"; and 
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US Patent Application No. 10/459,370, entitled "Systems and 



Processes for Decoding Chain Reaction Codes Through Inactivation." 
[0113] The foregoing description has been presented for purposes of illustration 
and description. It is not intended to be exhaustive or to limit the invention to the 
precise form disclosed, and obviously many modifications and variations are possible 
10 in light of the above teaching. The described embodiments were chosen in order to 
best explain the principles of the invention and its practical application to thereby 
enable others skilled in the art to best utilize the invention in various embodiments 
and with various modifications as are suited to the particular use contemplated. It is 
intended that the scope of the invention be defined by the claims appended hereto. 

15 CLAIMS 

What is claimed is: 
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